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[57] ABSTRACT 

Systems and methods for optically determining the 
direction of an object, such as a pointer, relative to an 
imaging system, particularly systems where triangula- 
tion is employed to determine the location of a pointer, 
within a generally planar viewing field, such as a touch 
screen. Rather than employing focused imaging systems 
to produce a sharp image at the plane of a photodetec- 
tor, and to thus define the visual pen for finger position, 
a deliberately diffuse or blurred image is employed. The 
diffusion produces a characteristic "bell-shaped" or 
Gaussian intensity distribution. By recognizing the 
characteristic intensity distribution, the position of the 
maximum intensity, and thus the direction of the object, 
can be determined to a small fraction of the distance 
between sample points, with an accordingly much 
higher resolution than focused systems. In a preferred 
embodiment, the position location system is incorpo- 
rated into a computer system as a touch screen appara- 
tus and a cursor is displayed on the screen as soon as a 
pointer is detected above the display. 
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touch screens in the prior art. Touch screens themselves 

DIFFUSION-ASSISTED POSITION LOCATION have been largely divided into two groups: overlay, in 

PARTICULARLY FOR VISUAL PEN DETECTION which a device sized to fit the display is placed over or 

attached to the display screen itself; and non-overlay, in 

BACKGROUND OF THE INVENTION 5 which no such display-screen-covering device is re- 

The present invention relates generally to systems for <{™red. Although not touch screens, the Stylus Detcc- 

optically determining the direction of an object relative ^on devices of the invention could be classed as non- 

tp an imaging system or for optically detennining the overlay. 

position of an object such as a pointer and, more partic- At the present time, by far the most commonly used 

ularly, to the use of imaging systems placed about a 10 touch screen technologies are overlay. Overlay touch 

computer display device to monitor the motions of a screens usually require placing a specially prepared 

pointer. device over the computer display and using the device 

There are so-called "touch screen" systems wherein a to determine the position, in two dimensions, of the 

user interacts with a computer system by touching or operator's finger or some other stylus. Typical examples 

pointing to various locations within a touch screen area, 15 involve one- or two-layer arrangements of glass or 

typically associated with a display such as a CRT, or plastic sheets which have been coated or patterned with 

other display device. The touch screen serves as easily special materials so that the position of a stylus or finger 

used data input apparatus because the operator can touch can be determined by making resistance or capac- 

quickly and easily feed data into a computer by indicat- itance measurements on the device. Another approach 

ing various specific positions of the touch screen area. 20 broadcasts acoustic waves on the surface of a specially 

As employed herein, the term "pointer" refers to any prepared piece of glass and determines two-dimensional 

suitable pointing object, externally illuminated or self- positions by timing when the waves have been attenu- 

iliuminated which is easily moved relative to a two-di- ated by a touch from a fmger or other sufficicnt i y ^m- 

mensional plane surface or area. By way of example and liant ^ lus> TOs latter devke lays cIaim t0 a ^vd- 

not limitation, the pointer may comprise a pen, stylus, 25 dimension sensin caprfjility but the « third dim e„sion" 

finger, or any typically long and slim element actually relates to firmness of touch, since no detection 

As employed herein the term touch screen" means at ^ ^ lace unti] tnc f or st lus b firmly m 

apparatus used to locate the position of a pointer within a with the disnlav screen 

ageneraUypl r rviewmgfield.Ina^ C0 £ 9 ^^ig^^ M ^ va ^^ 

invention, such a viewing field may be an area defined 30 . 1 " . B " ' . -*u *u 

on or near the surface of solid material, such as near an P° intm * * evice **« " » ^>ntact with the 

inert panel, or may be a geometric plane defined in *™* sur ff C ' 0VC A riay technol ??« ies suffcr from sevc t ral 

space or in the air ot " er P roo * cms - Any nominally transparent overlay 

Such "touch screens" have many possible applica- materiaJ reduces light transmission from the display and 

tions, for example: pointing to or selecting a particular 35 * so is an increased source of distracting reflections 

image or region on a video screen or on a panel, plate or from the ? ce °[ th f display Reflections are greatly 

tablet to select or indicate a specific item, informational creased for technologies such as resistive and capaci- 

element, letter, number, symbol, parameter line, region tive touch ^ Teen$ since the required overlays are 

or characteristic; to locate or track a pointer held gener- with a metallic film that acts as a mirror. These 

ally perpendicular to the plane and moved along the 40 overlays are often covered with diffusive coatings used 

plane for plotting data, drawing a graph or picture or to reduce the added reflections, but the diffusion also 

for laying out a network or diagram; for indicating or reduces the sharpness of the display. Thus the net result 

tracking the relative motion or coordinates of move- of applying overlay technology is a dimmer display 

ment or trajectory of a moving object; for use as a cus- which may also have a fuzzy appearance or disturbing 

torn keyboard in an electronic input module; and so 45 surface reflections. These problems are especially seri- 

forth. ous when dealing with liquid crystal displays, which are 

For convenience, the terminology "Stylus Detec- characteristically dimmer than desired even without the 

tion" is employed herein to refer to the subject inven- overlay. 

tion; it will be appreciated, however, that "stylus" re- Overlays also increase the problem of parallax. The 

fers to any "pointer" or other object whose direction 50 thickness of the overlay increases the distance between 

relative to an imaging system or position is to be deter- the display image plane and the point of touch. When 

mined. In addition, the term "camera" is employed the user moves his head, and thus the position of his 

herein as a synonym to imaging system, where a "cam- eyes, a fixed point being touched on the surface of the 

era" may be characterized as an electronic device for touch screen appears to move relative to the display 

capturing either one- or two-dimensional images and 55 image plane underneath. As a perpendicular distance 

converting them to electrical signals for further pro- between the image plane and the point of touch is in- 

cessing. creased, this parallax effect is magnified accordingly. 

In overview, the Stylus Detection system of the in- Overlay sensors also present a major logistical prob- 
vention employs two or more cameras placed strategi- lem for manufacturers. Typically, each model of com- 
cally about a computer display to obtain the position of 60 puter display requires a specially designed and config- 
the computer operator's hand or an object such as a pen ured overlay sensor. Even displays of the same nominal 
or stylus. The precise position of the hand or object is size tend to differ slightly in actual visible display area, 
determined using trigonometric triangulation. Pointer in curvature of the display surface, or even in the avail- 
position, as well as signals derived from the change of able space behind the display bezel, making the required 
position or the rate of change of position, can be inter- 65 overlay designs differ. This means that a large inven- 
preted as commands to the computer system. tory and an on-demand design capability be maintained 

The Stylus Detection devices of the invention most unless the touch screen manufacturer wishes to severely 

closely resemble what collectively have been called limit the display models to which his technology can be 
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applied. Furthermore, retrofitting displays for overlay 

touch screens is usually a complicated and specialized SUMMARY OF THE INVENTION 
job, not easily performed in the field. Accordingly, it is an object of the invention to pro- 
Non-overlay touch screens have thus far been largely vide improved systems and methods for optically deter- 
unsuccessful in the marketplace, due largely to the awk- 5 mining the direction of an object relative to an imaging 
wardness of the approaches which have heretofore system, particularly for application in systems for opti- 
been taken. One such device includes a linear array of caUy determining the position of an object within a 
perhaps twenty-five infrared light-emitting diodes generally planar viewing field, such as a touch screen, 
placed along one side of a display and a matched linear Briefly, and in accordance with an overall aspect of 
array of infrared detectors along the other side. When 10 ^ e invention, rather than employing focused imaging 
touching the display screen, the operator's finger breaks systems to produce a sharp image at the plane of a pho- 
a light beam, thus indicating position on the vertical axis todetector, and to thus define the stylus for finger posi- 
of the display. A similar arrangement at the top and tion » a deliberately diffuse or blurred image is em- 
bottom of the display is employed to determine horizon- P Io y«i- As explained in detail hereinbelow, it is possible 
tal axis position. As implemented, this prior art system 15 t0 det "ininc the position of the maximum intensity, and 
provides relatively low precision in determining two-di- * m direction of the object, to a small fraction of the 
mensional position. Because the diodes have to be dlsta / lc 1 c . ^tween sample points, with an accordingly 
placed a significant distance out from the display ™ch higher resolution than prior art focused systems 
screen, parallax is also a problem. While this system 7n ™ edlffus ™ produ^ces a characteristic ^ell-shaped" 
obviously has the ability to detect the approach of a 20 «2E^ 

finger or stylus some distance above the display, it actu- " TTi pno J" ^ systems \ aba f: 

ally is forced to use this above-display point as precisely ?° the T 5° Uld 

*#»iW,ai M * *~ » »u a ' 1 4nT* j . \* * * 00k ,lke - There is a trade-off between position-deter- 

t££ , ^ deteCt, ° n f i ™8 capabiUty and object-recognitton capability 

2 LI nf !JVi y P? ™* results in a poor feel 25 which is ^ b the ^ ubject 

and lack of tactile response, and contributes greatly to advantage is F that the £ ffusion Q J f the invention serve$ tQ 

the lack of success of the sensor. make the system rdatively insensitive to objects other 

Light pens are one of the oldest display interaction than the pointer which the system is designed to recoe- 

technologies available. Light pens are not usually nize. 

classed with touch screens, mainly for historical rea- 30 In accordance with a more particular aspect of the 
sons. They require a special stylus (the light pen) which invention, a system for optically determining the direc- 
typically must be tethered to a controller via a cord tion of an object comprises a photodetector having a 
carrying an electronic or optical signal from the display plurality of detector elements extending in at least one 
unit. Light pens require that a delicate balance be struck dimension, and elements for projecting a diffuse image 
between the persistence of the display and the achiev- 35 of the object onto the photodetector such that each of 
able horizontal resolution, a problem which is aggra- the detector elements produces an output signal corre- 
vated by color displays, which require three phosphors, spending to the intensity of that portion of the diffuse 
typically having different persistences. Light pens are image which is projected onto the particular detector 
completely non-functional in situations in which there element. As noted above, the diffuse image has a char- 
are significant dark (unlighted) areas in the target dis- W acteristic intensity distribution. The system additionally 
play, especially problematical with monochrome dis- includes a data analyzer connected for receiving the 
plays. These impediments have prevented the wide- output signals from the detector elements, which are 
spread use of light pens despite their early availability. token as a data set, and is operable to locate the position 
It will be appreciated that, in systems of the type ? f ™ e diffuse image on the photodetector by recogniz- 
eraploying imaging systems placed strategically about a 45 ™% a characteristic intensity distribution of the diffuse 
computer display, each imaging system includes a pho- image. 

todetector, such as a charge-coupled device (CCD) For example, the position of the diffuse image can be 

having a plurality of elements organized as an array, located by performing a least squares fit of a predeter- 

and a lens to focus an image of the pointer object onto ™ ned mtensit y distribution function (e.g. a Gaussian 

the photodetector. Assuming the position of the object 50 dlslnbution function) known to correspond with the 

image on the sensor array can be accurately determined, characteristic intensity distribution to the output signals 

the direction of the object relative to the imaging sys- J? m thc detector elements. Alternately, a transform, a 

tern can be determined in a straightforward manner ^ 0r 0ther S1 * nal P rocessin g technique can be used 

since position within the photodetector array is related « °" , ° Utp . Ut a S na]s i . fr0 , m l . he detec ! or elements to 

to the angular position within the field of view of the 55 u T™**. d,St r nbUtl0n f ™ Ctl °?' T 

imaging system, typically in a nearly proportional man- ^f^f"? a "T T? ^ 0Tm ^ on the 

ner. Given directions relative to at least two imaging 2 set ^ " * 

~ S?W r" 00X1 te 1 **™ hl f d b * Any one of a variety of techniques may be employed 

p - nf ' t Z'*l*tlit il . . r ^ focusing the lens by positioning the photodetector 

Prior to the present invention, the resolution of such where it is not in the image plane (focal plane) of the 

systems has generally been limited by the number of | enS . A difTuser such as a frosted screen or a layer of 

photodetector elements, although interpolation in some petroleum jelly in the optical path may be employed. 

cases has been used to infer an image position between 65 Various forms of fiber optic diffusers may be employed, 

two detector elements, for example. As described in such as fiber optic fans. 

greater detail hereinbelow, such is a highly inefficient In accordance with another aspect of the invention, 

use of a CCD array. mere - ls prov ided a system for optically determining the 
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position of an object within a generally planar viewing FIG. 15 depicts a lens and diffuser employed with a 
field. The system includes at least a pair of imaging bundle of optical fibers, 
systems in the same plane as the viewing field and ar- nFTATT pd FlFSrRiPTrnM 
ranged to view the object within the viewing field from ut * 1 A1LtlJ 1 AON 
different angular positions. Each of the imaging systems 5 Referring first to FIG. 1, a computer display device 
includes a photodetector having a plurality of detector 30 has a pair of suitably-mounted imaging systems or 
elements extending in at least one dimension, and ele- cameras 32 and 34 positioned at the upper corners, and 
ments for projecting a diffuse image of the object onto an optional central camera 36 to improve resolution 
the photodetector such that each of the detector ele- near the upper middle region of the display 30. 
ments produces an output signal corresponding to the 10 In general, the requirement for a camera is that it 
intensity of that portion of the diffuse image which is produce a representation of a field of view from its 
projected onto the particular detector element Again, vantage point that can be used in an analysis to deter- 
the diffuse image has a characteristicintensity distribu- mine the position of specific objects in that field of 
tion. A data analyzer is connected for receiving the view. This may likely involve the reduction of the 
output signals from the detector elements, taken as a 15 image to digital form for use in a computing device, but 
data set, and operable* to locate the position of the dif- it is also possible to produce a device in which analog 
fuse image on each of the photodetectors by recogniz- video data are used directly in determining the position 
ing the characteristic intensity distribution of the diffuse of objects in the field of view. The camera may there- 
image, and thereby to determine the direction of the fore be a real video camera in the usual sense of the 
object relative to each of the imaging systems, and to word, such as the J" CCD (charge-coupled device) 
determine the position of the object by triangulation arrays currently in common use, producing a digitized 
based on the thus-determined directions. two-dimensional depiction of the scene in terms of the 

RRiPT? nFQrpiPTinw np thp npAWiwrc levds of Iight (visible or ^visible) perceived from the 

BRIEF DESCRIPTION OF THE DRAWINGS vjmtage ^ It may ^ ^ ^ wrangeraent of de . 

While the novel features of the invention are set forth vices such as lenses, light carrying devices such as fiber- 
with particularity in the appended claims, the invention, optic cables, electric signal carrying cables, and light- 
both as to organization and content, will be better un- sensing devices such as CCD arrays. So long as the 
derstood and appreciated, along with other objects and camera effect is achieved, the physical layout of equip- 
features thereof, from the following detailed description 3Q ment to achieve the effect can be varied as required to 
taken in conjunction with the drawings, in which: produce a reasonable physical layout as constrained by 

FIG. 1A is a touch screen device embodying the the resulting cost and appearance of the device. The use 

invention, partially in schematic form; of a lens or similar device in a camera allows the posi- 

FIG. IB is a side view of the touch screen device, tion information to be gathered using a small, standard 

partially in schematic form. 35 device rather than a device which must be varied to 

FIGS. 2A and 2B are diagrams depicting resolution match the dimensions of the display as is the case with 

over different areas of the touch screen when two cam- most touch screen technologies, 

eras are employed; In the particular arrangement of FIG. 1, the cameras 

FIG. 3 depicts the geometry involved in determining 32, 34 and 36 include respective linear CCD photode- 

x and y coordinates by triangulation, given angles; 4q tectors 38, 40 and 42, such as Texas Instruments TSL- 

FIGS. 4A and 4B are diagrams comparable to FIGS. 214 devices. Each TSL-214 device has 64 photosensi- 

2A and 2B, but employing three cameras; tive cells arranged in a linear array approximately 5/16 

FIG. 5 is a plot of light intensity versus position along inch in length. The cameras 32, 34 and 36 also include 

a photodetector array for both a sharp image and a respective fixed lenses 44, 46 and 48. By way of example 

diffuse image; 45 and not limitation, the focal length of the lenses 44, 46 

FIG. 6 is a plot of light intensity versus position along and 48 is in the 3.0 to 4.5 mm focal length range. The 

a photodetector array in the case of motion of the dif- corner cameras 32 and 34 have nominal 90° wide aper- 

fuse image; ture lenses 44 and 46, while the central camera 36 has a 

FIG. 7 is a schematic representation of a simple lens 150' to 180° coverage lens 48. 

with its focal center arranged to give the lens 90* cover- 50 Significantly, the lenses 44, 46 and 48 are positioned 

age; so as to focus at distances greater than the distance 

FIG. 8 is a schematic representation of a focused lens across the display 30, or even "beyond infinity". Thus, 

system resolving a single point directly in front of the the photodetectors 38, 40 and 42 do not lie in image 

lens onto a linear sensor; planes in which an image of a pointer object 50 is 

FIG. 9 is a schematic representation similar to FIG. 8, 55 sharply focused, 

but showing the use of a diffuser, Outputs of the photodetectors 38, 40 and 42 are con- 

FIG. 10 is a schematic representation of a lens system nected to a data analyzer 52 which comprises an analog- 

which produces diffusion by de-focusing the image; to-digital converter 54, and a computer suitably pro- 

FIG. 11 is a schematic representation of a lens system grammed to perform the analysis described in detail 

depicting the situation wherein a light source is posi- 60 hereinbelow. 

tioned above the plane which should be imaged on a A pair of primary infrared light sources 56 and 58 are 

linear sensor, positioned near the corner cameras 32 and 34, and each 

FIG. 12 is a schematic representation of a focused have a nominal 90" spread, with a relatively narrow 
image system under the same conditions as FIG. 11; . spread out of plane. Optional secondary infrared light 

FIG. 13 depicts a fiber optic fan employed as a dif- 65 sources 60 and 62 are also provided, with a slightly 

fuser; narrower in-plane spread. All four infrared light 

FIG. 14 depicts a fiber optic fan with an auxiliary sources 56, 58, 60 and 62 are characterized as high out- 
diffusion sheet; and put. Associated with the display 30 is a bezel 64 which 
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has a background frame 66 that is non-reflective at the can be spaced around the rectangle of interest as re- 
infrared wavelengths employed. qu i rc d. Care must be taken to arrange or shade such 
General principles relating to the FIG. 1 configure- light sources so that they do not shine directly into any 
toon wiK now be discussed with reference to FIGS. 2A, camera or t0 sequence camera readings and illumination 

k , 5 sources so that this does not happen. 

Preferably, there are just two camera positions in the A favored mode p]ACes two or more K ht 

upper corners of a display as depicted. (Although the along the top of the rectangle with the cameres, with 

JSSTrfi the ,f ,SpIay ^ ob Z the light sources lensed in such a way as to produce 

ously be of any shape and the Tipper corners may be ? u , . * «. ti n , . ' r , 

any adjacent corned In fact, earned can be positioned 10 <^tiaUy a sheet of hght paraUel to the rectangular 
anywhere about the active area.) Since what *e cam- Surface ' sheet of hg , ht re ^ te / s 88 a ba ? d of h S ht 
eras distinguish is essentially the angular position of the i 0 ™ 88 1116 ***** ***** which passes through it. 
ringer or stylus, the sensitivity pattern of this arrange- Background readings can be taken when the light 
ment is shown in FIGS. 2A and 2B. As shown, the lines sources momentarily switched off and can then be 
are spaced apart by an equal angle. It can be seen that subtracted from the illuminated readings to produce a 
the coverage of the rectangle, although non-linear, is free of background interference for analysis. It is 

quite good with the exception of the region near the top P refer red mode of operation to provide a back- 

of the rectangle between the two cameras. ground that is black. This blackness, or absorption of 

FIG. 3 represents the geometry for triangulation, ^git from the illumination source, need prevail only in 
where the x and y coordinators are given by the equa- 1Q ^ wavelengths of light sensed by the cameras. Thus, if 
tions i0 the light sources are infrared and the cameras are sup- 

plied with infrared-passing filters, the background may 
, una mam be visibly white or odo^ so tong as it absorbs in the 

*° tana + ian/5 *nd >"= * tan /?. infrared. 

. It is also possible to operate without a special back- 
Directly between the cameras there is a singularity in " ground if it is known that there will be no interfering, 
the descriptive equations, where a=0=O. highly-illuminated objects. As can be seen from the 
From FIG. 2A, it is apparent that the vertical posi- equations, x and y are not restricted to be within the 
tion is wen-determined in the region between the cam- active region of the display, so this system is quite capa- 
eras, but that slight errors in the angle lead to large b le of sensing that an iUuminated object is beyond the 
tT rZt?Zt ^ ^ interest and can be made to ignore such 



In practice, this singularity is not a problem. Re- 
sponse is usably accurate except for a narrow band near ^ITvctP^ • _ . - . . . 
the top of the rectangle. Most displays are designed so M A^lTi ruTt baC ^! ound a 50 can 
that the cameras can be positioned some distance out- 5 band f ^. wavelengths to minimize 
side the rectangle that represents the active display 35 ^Z^L^TS* l,lummatl0n to this 
area, as in FIG 2B. In fact, most current touch screen TmJ^T^ A °^ mo 5 e 11 convement * use a 
technologies have similar requirements for an inactive ^ d *; band background lUumination and a nar- 
region near the edges of a display. row-band filter on the cameras. Illuminated back- 
When required, however, accuracy in the region f^,?" be *P* cia "y ™? situa ! io ™ where 
between cameras can be improved by adding the third 40 ™ hl * nX h * ht 1S bn « ht a " d C0 " fusin S ^^ugh to hamper 
camera position. Depending upon other requirements, xh \ Q ^on of a specific light source design, 
lighting in particular, the third camera can be positioned * ■ df -fl»™«ed stylus has the disadvantage of re- 
along the side or in another corner, as shown in FIG. ^""S a special stylus. The advantages however are 
4A, which gives complete and accurate coverage of the several - Fir s*> because the stylus itself is the light source, 
entire rectangle. 45 tnere »s no difficulty in providing a light which over- 
If conditions dictate, accuracy in the region between P° wers ambient illumination. Second, accuracy can be 
cameras can be substantially improved by positioning a significantly better than is possible with finger touch, 
third camera between the two corner cameras. A 180° J^ce the "stylus" is smaller and the light source makes 
camera is shown, although cameras serving lesser an- ^ true Point position better defined. Third, because the 
gles clearly would also be useful in increasing accuracy. 50 ^&h x source is relatively intense, there is less problem in 
Although in this case the three cameras are still situated determining when the stylus is actually in use. And 
so that singularities exist between them, FIG. 4B (which fourth, the stylus may send out modulated or other 
corresponds with FIG. 1) shows that the accuracy in signals to indicating touch-down or other operator mes- 
the upper region is substantially improved. sages. 

Lighting considerations are important to the overall 55 As noted above, a significant aspect of the invention 

accuracy of the system. The system can be made to k the use of diffuse or fuzzy images, produced such as 

work using ambient light, but greater dependability can ov a deliberate lack of focus. With reference now to 

be achieved using controlled lighting. The three basic FIG. 5, if one begins to look carefully at the process of 

forms of lighting are using a self-illuminated stylus, using a high-precision photodetector, such as a linear 

using a lighted background, and using specific light 60 CCD array to determine the position of a point light 

sources to illuminate a stylus or finger. Each method source, such as an illuminated pen tip, it is seen as a very 

can be more useful in specific situations. inefficient use of the photodetector array. Typically, 

Controlled, specific, light sources allow background- only one or two cells are illuminated, often to saturation 

ing, that is, taking periodic camera readings with the of the cell, and the rest of the cells are dark. The posi- 

specific illumination turned off, and also allow opera- 65 tion of the pen is determined by the number of the cell 

tion using only a narrow band of light wavelengths. that is illuminated, or the centroid number if more than 

LED s or IRLED's are particularly useful in this re- one cell is illuminated. The sharp peaked curve 100 in 

gard. Such specific sources can be few or numerous and FIG. 5 illustrates this behavior. 
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CCD cells are however quite capable of sensing the (f 0.3) with complete success. Likewise, for our usage 

intensity of light, typically distinguishing hundreds of the optical quality of the lens is of only minor impor- 

levels of intensity. In the typical prior art approach, tance; most of the imperfections that are usually of 

intensity information is used at just two levels; present concern in lens design merely contribute to the diffu- 

or absent. Furthermore, it is not at all clear that there is 5 sion. 

any way of using intensity information to improve the Diffusion can be achieved through any of several 

process. Thus, related prior art devices use focused mechanisms, and will in any case be the result sum of 

cameras to product a sharp image at the CCD plane and several mechanisms. Depending upon the situation, the 

thus define the stylus or finger position. precise nature of diffusion can be selected to advantage. 

In accordance with the subject invention, intensity 10 Possible sources of diffusion include: 1) de-focus or 
information is employed to advantage. Thus, if one other lens- (or pinhole- or slit-) related imaging imper- 
completely abandons the concept of a sharp image and fections, 2) intentionally placing a diffusion device such 
places a diffusion plate over the lens, for example, a as a frosted screen or a layer of petroleum jelly in the 
point light source, such as an iUuminated pen tip, will optical path, 3) digital- or analog-derived combination 
produce a characteristic "bell-shaped" intensity distri- 15 of the input intensities to produce mathematical or other 
bution 102. Because this shape 102 is characteristic, in non-optical diffusion, and 4) diffusion of the pointer 
fact symmetric in this case, if one samples the light object itself relative to a point source of light. As con- 
intensity at several points 104, 106, 108, 110, 112, 114 strained by the typical size of a touch screen, the human 
and 116 within the curve, it is possible to determine the finger itself is relatively broad and is thus a naturally 
position of the maximum intensity to a small fraction of 20 diffuse pointer object in comparison to a point source, 
the distance between sample points. Thus many fewer These various sources of diffusion are subject to vary- 
CCD cells, for example, are required to determine the ing amounts of control in the design of a system and the 
position of the light source to a given precision using a required diffusion will generally result from a partially 
diffuse, blurred image. Note that samples taken at the controlled combination of the several sources, 
evenly spaced positions 104, 106, 108, 110, 112, 114 and 25 As just described with reference to FIG. 5, diffusion 
116 completely miss the sharp image 100, while such is used to produce an intensity curve of known shape 
samples would quite adequately determine the position and with intensities varying along its length, the Gauss- 
of the diffuse image 102. ian distribution being physically and mathematically 

We are not getting something for nothing here. We very usable. Referring now also to FIG. 6, motion of 

have abandoned the image-producing capability which 30 the known shape can then be tracked as it passes over a 

is so key to the previous systems because we already discrete array of sensors and located with a precision 

know what the image should look like. In information that is a small fraction of the distance between sensors, 

theory terms, we are using the ability to precisely deter- A Gaussian curve 120 is again shown in FIG. 6, with a 

mine light intensity to augment an accurate but impre- shifted version 122 shown in dotted line representing an 

cise position measurement. There is a trade-off between 35 actual movement to the left of about one-fourth the 

position-determining capability and object-recognition distance between sensor elements. The sensor elements 

capability, so the pointer object must be very distinctive to the left of the central peak experience varying, but 

in intensity. This is easily true of an illuminated-tip pen. very specific, increases in light intensity, while those to 

It is also true of an opaque object, such as a finger, the right experience decreases. A further slight differ- 

obscuring a diffuse light-source, such as a diffuse light 40 ence in position makes a corresponding slight difference 

panel mounted around the perimeter of a display screen. in the length of each of the arrows in the diagram. From 

It is also true of a properly illuminated object Rather this it will be appreciated that measurement of move- 

than being a disadvantage, the diffusion serves to make ment of the curve 120,122 between two sensor element 

the system relatively insensitive to image details other positions is essentially a continuous process, the preci- 

than the pointer which the system is designed to recog- 45 sion being limited more by the error in the individual 

nize. Although a lens and diffusion plate is used in the intensity measurements than by the distance between 

example above, the fact that most clearly separates sensors. Of course, other factors, such as how well the 

diffusion-assisted and sharp-image position detection is intensity shape is known, also influence the precision, 
that no lens, slit, or other light-ray sharp focusing de- Although there are similarities, the process of finding 

vice is actually required by the diffusion-assisted 50 the exact position of a curve of known characteristics is 

method. not the same as what is commonly called interpolation. 

We have discovered that the intentional use of diffuse Typically, interpolation is applied with little, if any, 
images carries a significant side benefit. Because de- regard for the known characteristics of the shape, and 
focusing is one means of producing a diffuse image, the interpolation polynomial or other mathematical 
focus is a minor concern at most in constructing a cam- 55 form is applied to as few points as possible in the vicin- 
era for our use. In a focused-camera application, one ity of the area of interest, the concept being that what- 
must pay careful attention to maintaining a depth-of- ever mathematical form is being used will provide a 
field sufficient to keep the stylus or finger in reasonably better approximation to the real , curve over a small 
sharp focus over the complete range of distances from region. In doing this, the interest would be in finding the 
the camera that the. stylus or finger might be placed. 60 peak intensity and its position. We are much more inter- 
Indeed, in that usage, lack of focus can lead directly to ested in finding and tracking the position and character- 
a lack of accuracy or precision. Thus in focused-camera istics of the overall intensity shape curve than in track- 
devices, the lens aperture must be kept small, and often ing its localized peak intensity, which may move some- 
a pinhole or slit is used to insure adequate depth-of-field. what relative to the position of the overall shape. The 
This in turn requires that bright incident illumination or 65 approximate Gaussian we are tracking, the blurred 
an illuminated stylus be used. In one instance with our image of a finger, for example, is likely to be the sum of 
intentionally diffuse system, we have used a lens with an many closely spaced Gaussians from individual point 
aperture approximately twice its effective focal length light sources on the finger. As hand position changes, 
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these individual Gaussian sources will shift somewhat used if necessary for satisfactory performance near the 

relative to one another while still maintaining a good edges of the display. 

approximation to a complete Gaussian overall It is thus The light intensity pattern on the linear sensor 158 is 
more stable and generally better to track the complete essentially a sura of Gaussian distributions each result- 
shape rather than interpolating the peak intensity. 5 ing from some illuminated source in the field. The posi- 

Considering now several possible sources of diffusion tion of the finger or stylus can be represented by the 

in greater detail, FIG. 7 shows a simple lens 150 with its mean, p., of the Gaussian which corresponds to the 

focal center arranged to give the lens 90" coverage. In finger or stylus. There arc many ways of analyzing the 

the simplest of cases, the coverage can be considered to intensity data to extract u-, and the following has been 

be linear with angle, and the position of the lens 150 10 found to a reasonable compromise between computa- 

arranged to give the proper coverage. Because we use a tional intensity and dependability of the algorithm, 

diffuse image, the usual requirement that a wide angle The diffusion-assisted position locating concept also 

lens provide accurate edge-to-edge focus is not at all makes it possible to employ fiber optic elements 180 as 

important. Likewise, non-linear angle coverage in ex- an active part of the system rather than just passive 

treme wide angle lenses is not important, since any 15 message carriers. FIGS. 13, 14 and 15 show three differ- 

non-linearity can be corrected, if necessary, as part of ent arrangements of lenses and fiber optics, 

the x, y position calculation. Some attention must be The configurations of FIGS. 13 and 14 have no lens 

given to aperture shadowing at wide angles. The so- at all. An optical fiber has the characteristic that it will 

called cosine correction whereby the circular lens aper- accept light which enters an acceptance cone which 

ture looks like an ellipse when viewed from the side is 20 typically ranges about ±30' from the center axis of the 

the first of these effects. This phenomenon, which effec- fiber. This makes the optical fiber a diffuser in itself, 

tively reduces light passage at side angles, is often ac- without a lens or other image sharpening device, 

centuated by the three-dimensional aspect of the lens. By arranging the fibers in a fan shape, as shown in 

FIG. 8 shows a focused lens system resolving a single FIGS. 13 and 14, the acceptance cone for each fiber 

point 154 directly in front of a lens 156 onto a linear 25 takes in a slightly different range of angles over the 

sensor 158, which runs perpendicular to the surface of entire scene and the arrangement behaves much like a 

the paper. lens-and-diffuser system, but without requiring a lens. 

As shown in FIG. 9, the image can be diffused by Thus, the fiber fans have the property of averaging light 

placing a diffusing sheet 160 directly in front of the intensity over a range of angles as depicted in FIG. 5. 

linear sensor 158. The actual diffusion sheet 160 would 30 The arrangement in FIG. 14 uses a diffuser 190 to 

be much less conspicuous than shown in FIG. 9, very better control the amount and nature of diffusion expe- 

likely being a spray coating on the surface of the linear rienced in a fiber. The optical fiber by itself has a 

sensor array chip 158. sharper cut-off of light intensity at the extreme angles of 

FIG. 10 schematically shows a lens system which is the acceptance cone than would be the case for an ordi- 

producing diffusion by de-focusing the image, in this 35 nary diffuser, and the use of a diffusion sheet 190 can 

case by using a lens 162 with a longer natural focal correct this if it proves desirable to do so. Note that 

length positioned the same distance from the linear there is no reason a diffuser could not be effectively 

sensor array as in the figures above. Thus the image used between the fibers and the CCD sensor rather than 

plane is at 164. The triangular shape shown is in reality at the opposite end of the fibers, 

a three-dimensional cone, so that several adjacent cells 40 FIG. 15 uses a lens and diffusion sheet to feed light 

of the linear sensor array 158 receive light from the directly to an optical fiber, so that the effect is more 

object point. This representation is somewhat simplistic nearly that of sampling a specific angle in the graph of 

in that the true distribution of light approximates a FIG. 5. Clearly, the configuration of FIG. 15 offers 

Gaussian distribution rather than falling off sharply at more control over the degree of diffusion than is possi- 

the edges of the cone, but the general concept is correct. 45 ble in either FIGS. 13 or 14. If this increased control is 

The use of a defocused image has a side effect that is necessary, it is available, 

of importance in designing a diffused image system. In For best performance, this system of the invention 

FIG. 11, a light source 166 is positioned above the plane requires a separate detection of touchdown. When an 

168 which should be imaged on the linear sensor 158. illuminated stylus is used, this can be achieved by hav- 

Because the image is de-focused, the cone of light from 50 ing a tip switch in the stylus that causes a separate signal 

the source is picked up by the sensor, giving a false or to be sent to the system controller. Although there is a 

interfering signal. Thus, even if a special black back- current active market for LED matrix touch screens 

ground is erected to cover the image plane which the which detect the finger above the display and thus do 

sensor is designed to see, a de-focused system can also not detect touch well, this behavior limits the usefulness 

see extraneous light sources which are at a low angle 55 of these devices. With finger activated devices, some 

above the barrier. other detection is required. We use methods which 

As shown in FIG. 13, a focused image system does involve detecting the small motion of the display that 

not have this problem (although internal reflections comes with the force of touch. We have used with 

may still create similar problems in focused systems). success a touch detector 67 consisting of a piezoelectric 

Even if a diffusion sheet is used in the focused system, 60 speaker surrounded on each side by foam sponge (i" 

the sheet can be narrow enough to just cover the linear uncompressed) to act as a spring allowing small motions 

sensor 158, and thus not be subject to the same problem and positioned under the rear edge of a standard CRT 

as in FIG. 11. In practice, a compromise must be struck. display. The output of detector 67 is applied through 

The background, and even more so the extraneous light A/D converter 54 to data analyzer 52. The sudden 

source are necessarily relatively far from the lens, and a 65 shifts in the mean of the harmonic motions detected by 

lens which is focused for distance will still be diffuse for this device indicate that the display has been touched, 

nearer objects. Thus, in practice, the lens is more nearly These are true touch events if the camera devices also 

focused for distance, and supplementary diffusion is detect that the display screen is being touched. Such 
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motion can be detected employing piezo devices, strain though other methods might be used). The Gaussian 
gauges, devices which depend upon resistive changes, distribution is 
as well as devices in which the motion brings closer the 
plates of a variable capacitor, or LVDT-like devices in 
which the inductance of a coil is varied through motion. 5 
It will be understood that detector 67 is intended to y 
illustrate one simple example of a motion detector sys- 
tem for detecting touch of the screen, and other known which y is the intensity, x is the position within the 
touch detection systems could be substituted therefor. **W» running from 1 to 64, and <r 2 is the variance. This 

Careful implementation and data analysis can also 10 equation can be transformed to 
handle "backgrounding" in a fairly straightforward 

maimer. As a practical illustration, consider a system in in y = aq + A\x + xyA where 

which the stylus (or finger) is illuminated using infrared 

LEDs as a source. The illumination can be either inter- r 2 -i 

nal or external to the stylus. In environments which 15 = in £ lAi 

may experience intense stray illumination, as from auto L J 

headlights, carnival lights, or the like, the CCD sensors 

may give false readings. If the LED illumination is 6X1(1 

cycled on and off in synchronization with the CCD 

reading cycles, the illumination may be intentionally 20 Al „ L_ 

left off for some cycles and the resulting CCD reading la * 
used as background. 

By way of specific example, using a clock-driven Thus, if the A's are determined 
analog to digital converter (ADC), data are taken repre- 
senting the light intensity observed at each of the 64 25 a x 
sensors of the Texas Instruments TSL214 in each of the = " UT ' 

two or three cameras being used. This data taking oper- 
ation is initiated at regular intervals typically in the The form for In y above is suitable for applying linear 
range of l/25th to 1/I00th of a second, the interval least squares, whereby 
being decided mainly by the time required to produce 30 
an intensity amplitude sufficient for analysis in the dim- 
mest area of the field, r n r« s a rr'r"* "n 

These data are read into the digital computer memory I °l I t=\ /=l "** i-i I \ m"** I 
(for example using direct memory access, an interrupt I I I « n n \ \ n \ 
or by polling the ADC). The data are then analyzed 35 M* H ;h WfiC WfK ? X i W(X? , 
using the following process: * /=l 1=1 1 1 ,=l 1 

First, the intensity data are corrected for background j a 2 I II w x x? i wrf i wrf I \ I wtftoyi \ 

intensity (if necessary) by subtracting out a background ■ I U=l 1 /«i J U= 1 -J 

value for each of the 64 cells. These background values 

typically comprise the average intensity seen by the cell 40 wnere n=h--l+l is the number of joints selected for 
in quiescent periods. The objective is to produce a clean the P eak region and w/ is a suitably chosen weighting 
signal that does not contain spurious peaks of intensity factor. In the standard application of least squares to the 
that might confine the following process, particularly in original Gaussian equation for y/, the weighting factor 
the locating of the peak region. In a well-controlled would be chosen as w/=y/to compensate for the loga- 
lighting situation, background subtraction may not be 45 ritn mic transformation that was required to use linear 
necessary at all. least squares. In the method currently used, however, 

The data are then searched for a region including a tm ^ weighting factor is used to aid in producing a 
peak value of intensity. This is currently done by smooth progression of p as the Gaussian distribution 
searching for the set of n sequential points for which the moves across the array of cells. This is achieved by 
intensities sum to the highest value. Our experience is 50 usin£ weights which are largest near the central, peak 
that values of n in the range of 6 to 10 produce good values of the distribution and diminish to much smaller 
results with a 64 element sensor. The central position of values at the ends of the selected arrays. If y e is the 
the n points is then taken as a reference. central (nominal maximum) intensity, and p«max (c, 

Starting from the central point, and going in both n-c-1), then one suitable weighting factor is 
directions, the array of data is examined to find the first 55 

point index below some threshold percentage (typically , . . , , 

60% to 80%) of the average intensity in the peak region. Wi " * ~ 1 1 " # and » m <i c -fl + i|r 

The lowest index in this region is called 1 and the high- 
est, h. This process defines a region which encompasses each of which has been used successfully with q= 1, 2 
the peak region of the dominant Gaussian and avoids 60 and 3. Optimal choice of the weighting function de- 
the tail areas where the dominant Gaussian may be pends upon the diffusive characteristics of the cameras, 
confounded with non-dominant peaks. Because in this process all of the intensities usually have 

The light intensity pattern in the selected region is been selected to be within 60% or closer to the highest 
primarily the Gaussian distribution resulting from the intensity, the logarithmic transformation is usually su- 
finger or stylus in the field and its position can be repre- 65 perfluous in application. Because it saves computation 
sented by the mean, ji, of that Gaussian. The current time, y/ is generally used in place of lh y,in the above 
method used for extracting \l is by least-squares fitting equations. Additionally, when using weighting factors 
of the data in the region to the Gaussian curve, (al- similar to those described above, it is seen that the in- 
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verse least-squares matrix above does not depend upon gle. The distance L is generally taken through field 

the intensities, y, and can therefore be computed and calibration rather than by direct measurement, 
inverted in advance. Because sets of n points, where If it is necessary to use a third camera to adequately 

n < 64. are generally used, and n is variable, when using cover the less precise region at the top between the two 

this approach it is necessary to precompute a number of 5 cameras, that camera may be placed in another comer, 

EKSESSl ^^P^oneoftheseto m which case the data analysis simply pairs the new 

T^cfdS^^^^^^ E£ Ae upper t0 

sideration during this selection and weiehtine ©recess w v. " : ttUUVC 

As stated above? the distribution^^ 10 » • «pe*w«te angle camera is used between the two 

place about the nominal maximum ^JKKH * ?* ^JT^**" """^ Y m 

near either end of the array, it is Cmte die * ^T^Z C °™ T ^ ™* 

weights still center about y c even though the end of the x d,8carded The Gaussian curve fit is the same for 
array will truncate the symmetrical effect. This ap- tbe C€ . J""? for , conier camcras ^th the 
proach causes the progression of a to remain uniform 15 l^ ixon , that, if an angle-distorting lens, such as a 
even near the ends of the array, fish-eye, is used, the angle is no longer be linear with 

Note that this approach yields position in the 64 element array and correction appro- 

priate for the lens must be made. If the center camera is 
positioned a distance 



02 u * 20 



as well as jx. The value of cr is a useful diagnostic. The 2 
value of <r represents the relative broadness of the 

Gaussian curve and depends not only upon the diffu- . om the Ieft corner camera, and a distance y above the 
siveness resulting from the camera system but also on 25 line between ^ corner cameras and the angle for the 
diffusiveness resulting from the size of the subject. Thus center camera, 7, is measured counterclockwise, then 
values of cr which should validly represent, say, a finger x=C+(Y+y) tan(y-90°), where y is as determined 
touching the display typically fall within a narrow from the corner cameras. Again, C and Y are generally 
range and cr is only weakly dependent on the image size determined by field calibration rather than by direct 
and intensity. When the analysis results in a value of <r 30 measurement. 

outside that range, the analysis can be rejected as not "Pairs of x, y coordinates are reported whenever the 
representing a true finger touch. Similarly, when con- above process produces valid results and the point falls 
trolled illumination is used, a valid touch within the within the active area of the display and the computed 
display area will be found to produce at least a certain value of o% the spread of the Gaussian representing the 
minimum intensity, and signals below that level can be 35 stylus or finger touching the display, falls within a valid 
safely rejected as invalid. range. If the touch sensing device senses that the display 

With an ordinary camera and lens, the value of u., has actually been touched during a period of valid dis- 
which represents a position within the sensor array, is play, then the touch event is also reported 
directly proportional to the angular position in the field The foregoing specific example can be summarized as 
of view of that camera. Thus, ^ the following steps: 

(1) At intervals of nominally l/50th second, a clock- 
3 -*. a driven analog to digital converter (ADC) reads light 

a « • intensity data from each of the 64 sensors of the Texas 

Instruments TSL214's in each of the two or three cam- 
where a is the angular position of the object in the field, 45 eras being used. The data are entered into the memory 
Oo is a calibration bias to correct for the true camera for a digital central processing unit (CPU) using direct 
angular position, and Aa is the angular field of view memory access or interrupt, as appropriate for the pro- 
represented by the 64 cells in the array. Both a* and Act cessor. 

are determined through calibration in the field. Simi- (2) Using the CPU, each array of 64 values is treated 
larly, for the second camera, 50 as described in steps (2a) through (2h). 

(2a) First, a background intensity is subtracted out 

B - a + Afl-£- fr0m the each intensitv dat um> the background being 

p - pq + p ^ , determined previously as an average intensity seen by 

the cell in quiescent periods. This step may not be re- 
and fi represents the angle of the object in the field of 55 quired if the quiescent signal is well-behaved. If the 
view of that camera. resulting intensities are below a pre-determined thresh- 

If a, measured counter-clockwise, is for a camera old value, indicating no touch present, abandon the 
positioned in the upper right corner of a rectangle and process for this time interval. 

fi, measured clockwise, is for a camera positioned in the (2b) Search through the 64 points to find the 7 intensi- 
upper left corner of the same rectangle, with the dis- 60 ties in sequence which have the highest sum. Call the 
tance L between the focal centers of the two cameras, array index of the central point in these 7, c. 

(2c) Starting from the lowest index of the 7 points and 
decreasing the index, search for the first intensity below 
x = ttanct «nd v « x ton n 0.6 of the average intensity of the seven points deter- 

tana + uul * y * 65 mined above and call its index 1. Starting at the highest 

„. a . J r _ _ . ^ indexed of the seven points and going up in index, find 

where x is measured from left to right across the rectan- the first intensity below 0.6 of this same average and call 
gle and y is measured from top to bottom of the rectan- its index h. 
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(2d) Operating in the region between 1 and h, fit the 
Gaussian distribution 



in which y is the intensity, x is the position within the 
array, running from 1 to 64, ji is the mean of the Gauss- 
ian, which can be taken as the precise position of the ]0 
target object, again from 1 to 64, and a 2 is the variance. 
Use the logarithmic transformation of this equation: In 
y=Ao+Aix+A2X 2 , where 



18 



where a is the angular position of the object in the field, 
a 0 is a calibration bias to correct for the true camera 
angular position, and Aa is the angular field of view 
represented by the 64 cells in the array. Both etc and Aa 
are determined earlier through calibration. If the cam- 
era has a fish-eye or other non-linear lens, further cor- 
rections to the angle calculation may also be required in 
this step to correct for the non-linearity. 

(3) After obtaining valid measurements of a, mea- 
sured counter-clockwise, for a camera positioned in the 
upper right corner of a rectangle and 0, measured 
clockwise, for a camera positioned in the upper left 
corner of the same rectangle, then compute 



15 



L tan a 
* ~ Una + Un£ 



so that once the A's are determined 



(2e) Step (2d) is realized by forming the sums in the 
following equation, inverting the least squares matrix, 
and multiplying the inverse matrix by the y sum matrix 
to obtain A's. 

M rir' it** & wi *] \,lr to * 1 

L*J Ui^At>J,-* , J U^H 

where n=h-l+l is the number of points selected for 
the peak region. This process can be speeded up, com- 
putationally, without harm, by pre-forming and pre- 
inverting an appropriate set of the x sum matrices to be 
used in the process and also by using y/in place of In y, 
in the y sum matrix. 

(2Q The term wt used in the above is a weighting 
factor which places the heaviest weight on the point 
indexed with c, tapering to a much lower weight at 1 
and h. Symmetry about c is preferred. The form 



(|e - i| + l) 2 



is easily computed and generally works well. 
(2g) Compute 



o- 2 « ~ u well as fi - — 



1*2 



If the value of <r is imaginary or not within a predeter- 
mined band that has been selected to represent a valid 
touch (using the present equipment) abandon the analy- 
sis for this time period. 

(2h) Calculate the angular position from the value of 
u. using 



a » ao + Aa 



M 
64 



and y=x tan /3, where x is measured from left to right 
across the rectangle and y is measured from top to bot- 

20 torn of the rectangle. The distance L is the distance 
between cameras, but is calculated from an initial cali- 
bration rather than by direct measurement. 

(4) If the point measured in step (3) is located in the 
region at the top of the rectangle between the two cor- 

25 ner cameras and better accuracy is required, complete 
the analysis using the value of y, the angle measured 
counterclockwise from a super-wide angle camera be- 
tween the two at the top corners of the rectangle. This 
camera is at a distance 

30 

from the left corner camera, and a distance Y above the 
35 line between the corner cameras. Compute 
x=C+(Y+y) tanCy-W) where y is as determined 
from the corner cameras. Again, C and Y are generally 
determined by field calibration rather than by direct 
measurement. 

40 (5) Report the pairs of x, y coordinates. If the touch 
sensing device senses that the display has actually been 
touched during a period of valid display, then also re- 
port that the display has been touched. 
(6) Starting at the next time interval, repeat the entire 

45 analysis. 

From the above discussion, it will be appreciated that 
the present invention provides a method and apparatus 
whereby the pointer object 50 shown in FIG. IA is 
precisely located by photodetectors, such as photode- 

50 tectors 38, 40 and 42. In the preferred embodiment, the 
photodetectors 38 and 40 are positioned at the upper 
corners of the display 30 and the detector 42 is posi- 
tioned at the top center of the display 30. In this ar- 
rangement, the pointer object 50 is located or posi- 

55 tioned precisely with respect to the photodetectors by 
triangulation as previously described. Since the photo- 
detectors are placed in a known position with respect to 
the display 30, the position of the pointer object 50 with 
respect to the screen 30 is also known. In the preferred 

60 embodiment, the data analyzer 52 (computer) is pro- 
grammed to display a cursor 51 on the screen 30 as soon 
as a pointer object 50 is detected near the display 30 
(about 1 inch from the display 30) by the photodetectors 
38, 40 and 42. The cursor 51 may be displayed in a 

65 position precisely corresponding with the center of the 
pointer object 50 or the cursor may be displaced slightly 
with respect to the object 50 as illustrated in FIG. 1A 
where, the cursor 51 is displaced upwardly and to the 
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left of the pointer object 50. In some circumstances, a 7. A system in accordance with claim 5, wherein an 
slight displacement of the cursor may prove to be an optical path is defined between the object and said pho- 
advantage. For example, if a finger is used as the pointer todetector, and which system further comprises a dif- 
object 50, and the cursor 51 is positioned directly in the fuser positioned in said optical path, 
center of the finger, the finger will hide the cursor when 5 8. A system in accordance with claim 6, wherein an 
the screen is touched. By displacing the cursor up- optical path is defined between the object and said pho- 
wardly and slightly to the left, the cursor 51 will remain todetector, and which system further comprises a dif- 
visible to the user at all times, even when the screen is fuser positioned in said optical path, 
being touched. In such a case, a line from the center of 9. A system in accordance with claim 1, wherein said 
object 50 to cursor 51 is oblique (not perpendicular) to 1° data analyzer includes elements for locating the position 
the display 30. Thus, by displacing the cursor 51 slightly of the diffuse image on said photodetector by perform- 
with respect to the pointer object 50, one may actually ing a least squares fit of a predetermined intensity distri- 
achieve greater precision, because the user will always bution function known to correspond with the charac- 
have a visual feedback as to the cursor position, even teristic intensity distribution to the output signals from 
when the screen is being touched. 15 said detector elements. 

Also, by displaying a cursor before the screen is actu- 10. A system in accordance with claim 9, wherein the 
ally being touched, the user may more accurately posi- predetermined intensity distribution function is a Gauss- 
tion the pointer object 50 and touch the screen at the ian intensity distribution function, 
desired location, which is normally required on a touch 11. A system in accordance with claim 1, wherein 
screen to select a desired function. 20 said data analyzer includes elements for locating the 

While specific embodiments of the invention have position of the diffuse image on said photodetector by 
been illustrated and described herein, it is realized that performing a signal processing operation to extract 
numerous modifications and changes will occur to those from the output signals from said detector elements the 
skilled in the art. It is therefore to be understood that characteristics of a predetermined intensity distribution 
the appended claims are intended to cover all such function known to correspond with the characteristic 
modifications and changes as fall within the true spirit intensity distribution. 

and scope of the invention. 12. A system in accordance with claim 11, wherein 

What is claimed is: the predetermined intensity distribution function is a 

1. A system for optically determining the direction of 30 Gaussian intensity distribution function. 

an object, said system comprising: 13. A system in accordance with claim 1, wherein 

a photodetector having a plurality of detector ele- said data analyzer includes elements for locating the 
ments extending in at least one dimension; position of the diffuse image on said photodetector by 

elements for projecting a diffuse image of the object performing a transform on the output signals from said 
onto said photodetector such that each of said 35 detector elements taken as a data set. 
detector elements produces an output signal corre- 14. A system in accordance with claim 1, which com- 
sponding to the intensity of that portion of the prises an element for illuminating the object with radia- 
diffuse image which is projected onto the particu- tion having a recognizable characteristic, 
lar detector element, the diffuse image having a 15. A method for optically determining the direction 
characteristic intensity distribution; and ^ of an object, said method comprising: 

a data analyzer connected for receiving the output projecting a diffuse image of the object onto a photo- 
signals from said detector elements and operable to detector having a plurality of detector elements 
locate the position of the diffuse image on said extending in at least one dimension such that each 
photodetector by recognizing the characteristic of the detector elements produces an output signal 
intensity distribution of the diffuse image. 45 corresponding to the intensity of that portion of the 

2. A system in accordance with claim 1, wherein said diffuse image which is projected onto the particu- 
elements for projecting a diffuse image comprise a lens lar detector element, the diffuse image having a 
arranged to focus a sharp image of the object at an characteristic intensity distribution; 

image plane, in which said photodetector is not posi- locating the position of the diffuse image on the pho- 
tioned. 50 todetector by recognizing the characteristic inten- 

3. A system in accordance with claim 2, wherein said sity distribution of the diffuse image, 
photodetector is positioned between said lens and the 16. A method in accordance with claim 15, wherein 
image plane. said step of projecting a diffuse image comprises em- 

4. A system in accordance with claim 1, wherein said ploying a lens to focus a sharp image of the object at an 
elements for projecting a diffuse image comprise a fo- 55 image plane in which the photodetector is not posi- 
cusing lens and a diffuser positioned between said lens tioned. 

and said photodetector. 17. A method in accordance with claim 15, in which 

5. A system in accordance with claim 1, wherein said said step of projecting a diffuse image comprises em- 
elements for projecting a diffuse image comprise a plu- ploying a plurality of optical fibers, with one end of 
rality of optical fibers, one end of each of said optical 60 each of the optical fibers being arranged to collect opti- 
fibers being arranged to collect optical radiation and the cal radiation, and the other end of each of the optical 
other end of each of said optical being arranged to fibers being arranged to deliver optical radiation to one 
deliver optical radiation to one of said detector ele- of the detector elements. 

ments. 18. A method in accordance with claim 17, which 

6. A system in accordance with claim 5, wherein said 65 comprises employing a plurality of optical fibers with 
one ends of said optical fibers are arranged in a fan the one ends of the optical fibers arranged in a fan con- 
configuration so that each optical fiber collects optical figuration so that each optical fiber collects optical 
radiation from a different direction. radiation from a different direction. 
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19. A method in accordance with claim 15, wherein ranged to collect optical radiation and the other end of 
said step, of projecting a diffuse image comprises em- each of said optical being arranged to deliver optical 
ploying a diffuser. radiation to one of said detector elements. 

20. A method in accordance with claim 15, wherein 30. A system in accordance with claim 29, wherein, 
said step of locating the position of the diffuse image on 5 for each of said detector systems, said one ends of said 
the photodetector comprises performing a least squares optical fibers are arranged in a fan configuration so that 
fit of a predetermined intensity distribution function each optical fiber collects optical radiation from a dif- 
known to correspond with the characteristic intensity ferent direction. 

distribution to the detector element output signals. 31. A system in accordance with claim 29, wherein, 

21. A method in accordance with claim 20, wherein 10 for each of said detector systems, an optica] path is 
the predetermined intensity distribution function is a defined between the object and said photodetector, and 
Gaussian intensity distribution function. which system further comprises a diffuser positioned in 

22. A method in accordance with claim 15, wherein said optical path. 

said step of locating the position of the diffuse image on 32. A system in accordance with claim 30, wherein, 

the photodetector comprises performing a signal pro- 15 for each of said detector systems, an optical path is 

cessing operation to extract from the output signals defined between the object and said photodetector, and 

from said detector elements the characteristics of a which system further comprises a diffuser positioned in 

predetermined intensity distribution function known to said optical path. 

correspond to the characteristic intensity distribution. 33. A system in accordance with claim 25, wherein 

23. A system in accordance with claim 22, wherein 20 said data analyzer includes elements for locating the 
the predetermined intensity distribution function is a position of the diffuse images on each of said photode- 
Gaiissian intensity distribution function. tectors by performing a least squares fit of a predeter- 

24. A method in accordance with claim 15, wherein mined intensity distribution function known to corre- 
said step of locating the position of the diffuse image on spond with the characteristic intensity distribution to 
the photodetector comprises performing a transform on 25 the output signals from said detector elements. 

the output signals from said detector elements. 34. A system in accordance with claim 33, wherein 

25. A system for optically determining the position of the predetermined intensity distribution function is a 
an object within a generally planar viewing field, said Gaussian intensity distribution function. 

system comprising: 35. A system in accordance with claim 25, wherein 

at least a pair of detector systems in the same plane as 30 said data analyzer includes elements for locating the 

the viewing field and arranged to view the object position of the diffuse images on each of said photode- 

within the viewing field from different angular tectors by performing a signal processing operation to 

positions, each of said detector systems including a extract from the output signals from said detector ele- 

photodetector having a plurality of detector ele- ments the characteristics of a predetermined intensity 

ments extending in at least one dimension, and 35 distribution function known to correspond with the 

elements for projecting a diffuse image of the ob- characteristic intensity distribution, 

ject onto said photodetector such that each of said 36. A system in accordance with claim 35, wherein 

detector elements produces an output signal corre- the predetermined intensity distribution function is a 

sponding to the intensity of that portion of the Gaussian intensity distribution function, 

diffuse image which is projected onto the particu- 40 37. A system in accordance with claim 25, wherein 

lar detector element, the diffuse image having a said data analyzer includes elements for locating the 

characteristic intensity distribution; position of the diffuse image on each of said photodetec- 

a data analyzer connected for receiving the output tors by performing a transform on the output signals 

signals from said detector elements, and operable from said detector elements taken as a data set. 

to locate the position of the diffuse image on each 45 38. A system for determining the position of an object 

of said photodetectors by recognizing the charac- adjacent to a surface of a display having a perimeter, 

teristic intensity distribution of the diffuse image said system comprising: 

and thereby to determine the direction of the ob- at least a pair of detector systems positioned outside 

ject relative to each of said detector systems, and to of and adjacent to the perimeter of the display and 

determine the position of the object by triangula- 50 arranged to view the object from different angular 

tion based on the determined directions. positions and to view the object when it is posi- 

26. A system in accordance with claim 25, wherein tioned on the surface of the display and when the 
said elements for projecting a diffuse image comprise a object is positioned adjacent to the surface of the 
lens for each of said detector systems arranged to focus display, but spaced apart from the display, each of 
a sharp image of the object at an image plane in which 55 said imaging systems including a photodetector 
said photodetector is not positioned. and elements for projecting a light pattern corre- 

27. A system in accordance with claim 26, wherein, in sponding to the object onto said photodetector 
each of said detector systems, said photodetector is such that said photodetector produces output sig- 
positioned between said lens and the image plane. nals corresponding t the intensity distribution of 

28. A system in accordance with claim 25, wherein 60 the light pattern; and 

said elements for projecting a diffuse image comprise, a data analyzer connected for receiving the output 

for each of said detector systems, a focusing lens and a signals and operable to locate the position of the 

diffuser positioned between said lens and said photode- light pattern on each of said photodetectors and 

tector. thereby to determine the direction of the object 

29. A system in accordance, with claim 28, wherein 65 relative to each of said imaging systems, to deter- 
said elements for projecting a diffuse image comprise, mine the position of the object by triangulation 
for each of said detector systems, a plurality of optical based on the determined directions, and to display 
fibers, one end of each of said optical fibers being ar- a cursor on the display at a position corresponding 
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to the position of the object, said cursor being dis- 
played when the object is adjacent to, but spaced 
apart from, the display. 
39. The system of claim 38 further comprising a touch 
sensor for sensing a touch of the object to the display, 
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producing a touch signal when a touch is sensed, and 
transmitting the touch signal to said data analyzer. 

40. The system of claim 38 wherein said data analyzer 
displays the cursor at a position on the display that is 
5 shifted with respect to the object so that a line from the 
object to the cursor is oblique with respect to the 
screen. 

* * * * * 
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